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Review Activity 



J. ' Prbi^ttvs^ the T^QB3 Vocational^ Education Off erings Re view Executidn 

The several probieSs enumerated in , this section are not intended 
as criticisms of the Job Corps opirStibr] or staff. They are^ mentioned ^ ^ 
drily to help §uide' further reviews of this type on issues tb Sve^aome 
or avoid. These problems are presented iri four groups: operations-related, - 
pfograin data base,, occupational demarid expectations, and study dynamics. 
Most' have been discribed in the appropriate^ preceding Documentation . , 
Reports. ^ 

A. Operations -Re lat^d » ' 



1 Thi definition Of a "step-off" level occupation is riot 

: defitially established arid practice varies among centers. 

2 There is ambiguity in the identification of pccupktions 
in which corpsmembers are trained: Some centers assign 
"step-off" level-occupations to completers -fsupposed to 
be those corpsmembers enrolled for 90 days, or more 
complete the training objective they established mutually 
with Job Cdrps- counselors when first enrolled) .Others 

' do not and irideed report some early drspouts (those • 
leaving Job Corps in less than 90 days) . as trainees in . . 
• fairly advariced occupations. I ' . 

3 The practice of assigning "the best pbssiijle" ^ccupa- 

* • tibnal label to corpsmembers when they^ terminated^ based 
^pbn the Wdrk c^petencies they h,ave achieved in their 
trairiirig, apparently leads td disparate practicesm 
S^rtirii the occupations (or occupational obgectives) in 
Which corpsmembers were trained. Some i corpsmembers 
thus, appear to be labeled and ret)drted as trained in 
verySrow- skill occupations . with very shbrt minimal 
training time, which probably wduy not \ meet reasonable 
criteria for an bccupatibn worthy to be, taught in Job 
Cbrps. 1 • " 
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4; : ft ctaifreht inventory of Job Corps ocoupationai training is 
not maintained. # 

5i .The .training curricula of different'' Centers training^ 
members in what is reported as the sape occgpati^^ 
likely. to 1^ quite different, at least in some instances.^ 



^ 6* Job Corps' recruitment' and~a^i"gi^m"em"l) 

' large numbers of cbrpsmembers being enrolled in Centers 
, not in their, state bT res i^^ehce II and a 
'\ bar outside bf their DOL region of residence, -tea ^ 

> consequence^ : many Centers prbvide training to sizable 
' . " ' ;humbers of cbrpsrnembers frdm other states. Moreover, a \ 

sizable fraction _bf cbrpsmembers do not return to their 

. original place bf residence* when they leave Job Corps. , 

. *: therefore-^ tVie prbblem bf aligning occupational training 

offerings with _eiTi)lbyment demand in the labor market — 
. and analysis bf . sUch expected future demand to guide cur- 

rent training decisions — is most difficult. 



B . y Program Data j^Base 



1, Occupational training identification assigned to corpsmembers 
is-nincbhsistent, more than occasionally, with the training 
programs Centers report^they are offering. ' ^ 

2 The Jqb^brp^ MIS was restored to full capability only at ^ 
the beginning of FY 1982; consequently i, it was not possible 
for the present study (but it Will be for subsequent re- . 
views) to identify the sbcib-ecqnbmic characteristics of 

. corpsmembers recorded at time of entry into Jdb Corps with 
the cbrpsmembers* training occupation recbrded after ^exit. 
*. This precluded regression analysis to adjust raw ^outcomes ^ 
for important differences in trai-nee characteristics which 
are expected to affect job placement. / \ 

3 Financial^data — costs of vbcatibhal training — by . ^ 
bccupations of training are not . required to be maintained 

- by centers. Only total vocatibhal costs, and some functional 
subdivisions aie required. The special survey of Centers 
by ^hich occupatipnal training; costs wer^ collected may 
not have evoked . a consistent method of cost estimation from 
center to Center. Certainly there was Wide variation of 
' <:osts in training for nomirially the. same occupations> even 
^ from region to region. - v. • 

■ — " _ f 

4 Eimitation of "program "research" to data available through 
* program operating statistics in the MIS has some short- , - 

comings. The time periods on which the data are based are^ 
different for financial ^ata (fairly rigorois fiscal years) 
ahd pi^ram data lerid of reporting period Ikgs pver into 
next yfcar fiscal, particularly for 'data, frojn the Placement— 
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status Report— id^gtifying traini^_ occupatio^^ which 
can }>e delayed: six months or more). Additionally , t?he - * 
costs reported are those incurred in the fiScil year while 
the training output corpsmembers trained, job plfaced, ; 
etc w are to an uriknown extent the product of training - 
Cpsts" incurred in thfe ^rioir year. - ' .j' 



C. Occupational gemand Expectations ' * . /_ • 

• 1. ^The only "data available ^ within\reasdriable time^and itaff 
'expenditures^ for anticipating labor tnarlcet' demand^ oc-_ 
" cupation by bccupatibh were the BLS projects of occupa- 

o tional employment growth, natibhwide, 1980 to 1990^ published 
in 1981. State and/or are a^ occupational ernfiioyment prb- 
-jections, reasonably cbnsistent for all jurisdictions, were 
not available, ' state, data might be developed given enough - - 
lead time. and perhaps funding; ^ for a future study of this 
^ind. " • _ , . ■ 

2. 'ocdupational informatibh from diffe^^ frequently 
based on different definitions of many occupations, a 
* situation whiSh introducers ambiguities into "the analysis v 
Perhaps in the future^ all syptems will use the Standard 
r Occupational Classificatibh structure. 

3^ idbseiice of cdni>arable labor market a^ea projections of future, 
occupationil employment precludes national analysis of sub- 
■ state areas' labor mairket demand for fiurposes of assessing ^ 
the relation of training occupations to "the labor market.' _ 
It is (difficult enough to try to appraise occupational, demand 
^ in the labbr market at each Center when corpsmember trainees 
come?^rom /diverse geographical areas, and mariir do not return 
to their original residence. 

4.' There is no viable data base for estimating "benefits" i.e., 
increases of earnings -- by occupation. - 

b,. study 'Dy nam i c s ' . - 

The staffing It^ucture of; the current study is at best awkward. The 
support contractor does not have viable cbntrdl over the number of staff 
or professional .qqalificat ions, data sources, : etc. , to properly be held . 
accountable for deliviry of a final product. The study plan developed in- 
house before the support contract was awarded was a reflection mbr€ of 



what ETA iuahagemeht .would haVe lik^d. to have than of what a' sober Assess- 
ment of the dat|^ sources available \couid yield; . The consequent bri'^^^ 
adjustment of study objectives as staff work r.evealed tha- limitations of • ' 



avaiiable-data=---in=the^ecutting~^ 

in additional ambiguity. □ ^ • .. ' 



&ulteii^^^ 



ri T^e ^4tua 
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The experience of FY 1983 cbrpsmembei:^ trainees will already , 
.be iri the MIS (except for a considerable amount of plac^- ' 
ittent hence training occupation identification) by the time 
any follow-up. vocational offerings review process can be , 
initiated.' Accordingly, all the problems ehcduhtered in the 



review of FY 1982 trainees would 
corpsmember occupational coding 
quired) . 




ehcouhtered (e.g. , , the 
rif icatioh/cdrrection re- 



New BLS projections of occupational emplbymeht change to 
1995 will become available probably in October or* November 
1983. 



3*. Aaditionai data wii; bea^lable^frdm the MIS for FY 1982 

and FY 1983. terminees> frbm merging the ehrollee characterist 
computed file and the placement record file to produce corps- 
member characteristics by occupation of training. This will 
* permit more sophisticated , analysis df outcomes — noticeably 
job placement -- by bccupatidh. 

4. Some changes are'beihg ihtrdduced in Center training, occupa- 
tions in FY 1984. as a result of preliminary findings of the _ _ 
vocational education offerings review. More changes may ^ell 
b^ instituted by mid-S^ar following completion of the review. 
i^!TI5> corpsmember dccup^tions of _ tr aining maycirchange/ perhaps 
bnly marginally, in JFY 1984, from FY 1982; they probably did 
not change much in FY 1983. * 
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ill. Options fbr Cdhtim 

Activity _ - > - 

The exaihinati'dn of Job Corps performance by occupatibh df vocational 
training appears to have^been a productive undertaking^ hotwitiistanding. 
the problems . arid limitations. Continual vigilSnci iri imprdvirig program 
cost-effectiveriess is always^warraiSed.and_ continued 'p^^^ review^ 



l" ' ' tof •^erfSmwice.by 6ccupai^bh| Is^ one, (certain n5t the only) Way of . 
working toward :that goal. \ Indeed, since the ^aw data in this study 
•'Indicate relatively lower W pladement rates, among corpswbiheri than 

; an tong corps medV e speci ally irj th e largest tr aining occupations, cost- 

'. — I '. .l ~r~^ i ! J .; - ■ '. : 

eflectivehess might. be. most quickly improved .by some concentrated effort 

• ■ ■ /. , , , _ .1 . 

r " ' to place female cbrp^embers in. jobs upon their termination from Job Corps; 

\ •'- - One possible fOcus of a continuing vocational education offerings 

: revi,eWi on which there seem to bi no options, is not to repeat the 1983 

study of FY-.-igS^ cbrpsmember training in 1984 on FY 198r training. The . 

only change iiSbbably-tb maki^ the Results of such a ret.etition marginally 

• asefui ^ouldbe the mor^ %uliigh.i#>or market during^ calendar 1983 which 

could be expected to improve job placement rates. This would be but a 

* . ahall gain and probabiy would not warrant the expenditures of scarce staff- 

^ time -^d the dollar resources that vould be necessary to accoS^lish it-y 

... There are. three "firoad alternatives for pursuing the activity in the _ 

new fiscal year. Thpse alternatives assume that implementation of whatever 

decisions managiinen4;makes' concerning jrevising existing training^ bccupa- 

tions will be carried- but :as a regular Job Gorps staff Jfunctibn and not a 

cbritinuation of the revie>^ctivity. ; . 

ft eontirtiie the staff -study approach, with ^^^c^^ 

in put^it bf bne or more of the following otjectivp: _^ ^ 

1. /keahcLLyze the FY 1982 terminee grbuj) oh . . 

/of tlii verified/corrected occupational designations, , 
V/ with added data from merging the files tbpr 
/ cbrpsmertflDer characteristics by occupatibh. . 

; ■ . J , ■_ _ ■ ■ - _ .. ■ . - - , . — 

- ■ ■ 4- Assess the desirability of corpsWember gebgraphj^cal re- 

s^' ibcatibn to a new place of residence follbwing jterinina- 

/ tion frbm Job Corps and the role of National Contractors 

/vs. bther training providers in prbmotirig.it. - 



■f . ■ ' ■ . ■ ■ ' " ■ • • 
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3 Extend the analysis of FY 1982 training performance; 
using enhanced data base as per item i above * to trv 
-'to determine whether the lower job placement ^r^tespf 
female coipsmenvbejrs are due to labor market di3crimy- .- _ 
nation against women, tfie selection of occupatigns. in - , . 
which co^swomen are almost exclusively enrolled, C»r^_ 

3ome=othe^£act^.:^3g^ ^^»^lwi ffl l^rge ^^thdgg^^_ ^^ 

females from the labor force when they leave Job Corps, 
possibly associated with whether or not they hfve , 4 ^ „ 

children.. ^' ' ,•' 

4. Assess the quality and scope of skill training provided 

in VST as against the "classroom'^ method. , • , :. 

. ^5. Assess the quklity and scope of training prOvid^d^^in, 
maintainingand operating the eenters_^e.g.> 5^^^ 
against training: in tlSe. same occupatfSns vxa- cla^s- . 

room" pedagogical techniques i • 

■ ■ - ■ _ ^ :-^-':'SS' — ■' > 

■ ■ 6 ^seis whether occupation of training.is a significant^ 
input variable influencing job placement output, whether 
aufation of stay in Job eorgs is as significant^ jr^ore , 
significant than occupation of training, an<} If o^ 

lion of tSinihg is ^ significant^nfl^^^^ 

of stay in Job Corps. - ^ " - - 

... . ' - • ■ '.■ , ■ ■■ , r • ■ - - ■ 

B undertake totally contracted "special studies" -in lieu ^f. staff 

studies ?o illuminate selected problems.br issues In thi,s con- 
^ texl ••special studies" is u^ed to- %nnote the following activi- 

SSote-iSEdly relyiS 5 upon op.r«i„g . , 

Mis and established tiSihciil rSi«ts organi^^^ 
S tbb BbWa staff t5 learn is iSucH as may be learned from. 
, SoS liSd so.roes about given problem of policy iS=ue^ ^ 

te addltioh to most of tii 'topics iisted under i-<»9ve , the f oilo«K5, 

might be investigated-. .0 ' . . ' 

I' Assess relative cost-effectiveness bf different ^PP^^^^^ 

?S prSviding corpsmember training at the Center ^level,- e.g., 
to prpviaing^ Center staff, training contracted (by . 

' delivery agenty or other. • ^ --'a. - 



2. Undertake a cbst-behef it analysis of Job Corps training 
by major qccupatibh (i.e. the bccugatidha^n which tdUe 
inajbrity of corpsmembers are trained) , #hd/br the develop- 
ment K a psuedo- cost-benefit analysis technique , relying 
on short-term indicator s^_ as a proxy of earnings benefit, ' 
suitable for use by Job Cbi^ps staff on a continuing basis 

_i as an 'assessment tool f or apjfraij^ai of Center , training 



contractor^ regi^Tal^ or overaTl oc^up3:tiwa3r-tra±ning- 
performance . 



AddresG Jbb Corps staff resources to developing policy posit^ipns . . 
and preparing*pblicy^issuahces to rectify operational p^ac^ices^ . ^ 
which seSpi counterproductive from the viewpoint of rationalizing 
vocational .education offerings. For example, if cost data by ? . 

bccupation are xleemed important and will W^coiiectqd ag&in ^ ^ \ 

* ibmeday by mail ^survey of the Centers, staff shouid_ develop 

revised repbrtihg requirements to assur^^ that inters maintain t 
such -^a ta-^iiy * ^ t :lieir c€st accounting; Systems (even though it may 
not be. reported regularly) . in addition, award' a design contract ^ 
to develop a vbcatidhal^ education : of ferings review stu^y design 
r for implementation in EY 1985./ Develop a Ibnger term, Job Corps 

research agenda to be pursued both in-house and through contracted ; 
research efforts, impletnented perhaps by or in conjunction w^^ 
ETA ^ Office of Research* and Evaluation. 

' v.- ■ . 'i ...... . ' . ' 11 . . 
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